Papers by Diego De La Fuente Rodríguez
On the Correspondence between the Squared Norm and Information Content in Text Embeddings (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing evidence of the correspondence between the squared norm of an embedding and the information content of the text it represents is lacking. |
| Approach: | They propose to derive two sufficient theoretical conditions for this correspondence to hold in embedding models. |
| Outcome: | The proposed embeddings exhibit a strong correspondence with the word embeddables and the subword token composition functions. |